Goto

Collaborating Authors

 image deblurring


Deep Wiener Deconvolution: Wiener Meets Deep Learning for Image Deblurring

Neural Information Processing Systems

We present a simple and effective approach for non-blind image deblurring, combining classical techniques and deep learning. In contrast to existing methods that deblur the image directly in the standard image space, we propose to perform an explicit deconvolution process in a feature space by integrating a classical Wiener deconvolution framework with learned deep features. A multi-scale feature refinement module then predicts the deblurred image from the deconvolved deep features, progressively recovering detail and small-scale structures. The proposed model is trained in an end-to-end manner and evaluated on scenarios with both simulated and real-world image blur. Our extensive experimental results show that the proposed deep Wiener deconvolution network facilitates deblurred results with visibly fewer artifacts. Moreover, our approach quantitatively outperforms state-of-the-art non-blind image deblurring methods by a wide margin.


Review for NeurIPS paper: Deep Wiener Deconvolution: Wiener Meets Deep Learning for Image Deblurring

Neural Information Processing Systems

Clarity: Overall, the paper is written well, and easy to understand the main idea. However, there are some unclear points as follows: 1) There is no explanation why the feature-based Wiener deconvolution is better than image-based method. For example, is the proposed feature-based method better for estimating more accurate signal and noise level? Is the model "Ours w/o Wiener" guided by the input blur kernel? If you guide the kernel, how do you guide it to the network?


Review for NeurIPS paper: Deep Wiener Deconvolution: Wiener Meets Deep Learning for Image Deblurring

Neural Information Processing Systems

Overall, the reviewers were positive about the paper: the experimental results are very good, and the idea of using Wiener deconvolution in the feature space is interesting. After the rebuttal and discussion, the reviewers unanimously voted for acceptance. Please put the clarifications in the rebuttal into the final version.


Deep Wiener Deconvolution: Wiener Meets Deep Learning for Image Deblurring

Neural Information Processing Systems

We present a simple and effective approach for non-blind image deblurring, combining classical techniques and deep learning. In contrast to existing methods that deblur the image directly in the standard image space, we propose to perform an explicit deconvolution process in a feature space by integrating a classical Wiener deconvolution framework with learned deep features. A multi-scale feature refinement module then predicts the deblurred image from the deconvolved deep features, progressively recovering detail and small-scale structures. The proposed model is trained in an end-to-end manner and evaluated on scenarios with both simulated and real-world image blur. Our extensive experimental results show that the proposed deep Wiener deconvolution network facilitates deblurred results with visibly fewer artifacts. Moreover, our approach quantitatively outperforms state-of-the-art non-blind image deblurring methods by a wide margin.


Image Deblurring using MAXIM. Using the pre-trained MAXIM model to…

#artificialintelligence

There are new initiatives undertaken on Transformers and Multi-layer perceptron (MLP) models that provide new network architectural designs for computer vision tasks. Although these models proved to be effective in many vision tasks such as image recognition, there remain challenges in adapting them for low-level vision. The inflexibility to support high-resolution images and the limitations of local attention are perhaps the main bottlenecks. MAXIM is a multi-axis MLP-based architecture that can serve as an efficient and flexible general-purpose vision backbone for image processing tasks. MAXIM uses a UNet-shaped hierarchical structure and supports long-range interactions enabled by spatially-gated MLPs. Specifically, MAXIM contains two MLP-based building blocks: a multi-axis gated MLP that allows for efficient and scalable spatial mixing of local and global visual cues, and a cross-gating block, an alternative to cross-attention, which accounts for cross-feature conditioning. Both these modules are exclusively based on MLPs, but also benefit from being both global and'fully convolutional', two properties that are desirable for image processing. The proposed MAXIM model achieves state-of-the-art performance on more than ten benchmarks across a range of image processing tasks, including denoising, deblurring, deraining, dehazing, and enhancement while requiring fewer or comparable numbers of parameters and FLOPs than competitive models.


An Algorithm Unrolling Approach to Deep Image Deblurring

Li, Yuelong, Tofighi, Mohammad, Monga, Vishal, Eldar, Yonina C.

arXiv.org Machine Learning

While neural networks have achieved vastly enhanced performance over traditional iterative methods in many cases, they are generally empirically designed and the underlying structures are difficult to interpret. The algorithm unrolling approach has helped connect iterative algorithms to neural network architectures. However, such connections have not been made yet for blind image deblurring. In this paper, we propose a neural network architecture that advances this idea. We first present an iterative algorithm that may be considered a generalization of the traditional total-variation regularization method on the gradient domain, and subsequently unroll the half-quadratic splitting algorithm to construct a neural network. Our proposed deep network achieves significant practical performance gains while enjoying interpretability at the same time. Experimental results show that our approach outperforms many state-of-the-art methods.


An Algorithm Unrolling Approach to Deep Blind Image Deblurring

Li, Yuelong, Tofighi, Mohammad, Geng, Junyi, Monga, Vishal, Eldar, Yonina C.

arXiv.org Machine Learning

Blind image deblurring remains a topic of enduring interest. Learning based approaches, especially those that employ neural networks have emerged to complement traditional model based methods and in many cases achieve vastly enhanced performance. That said, neural network approaches are generally empirically designed and the underlying structures are difficult to interpret. In recent years, a promising technique called algorithm unrolling has been developed that has helped connect iterative algorithms such as those for sparse coding to neural network architectures. However, such connections have not been made yet for blind image deblurring. In this paper, we propose a neural network architecture based on this idea. We first present an iterative algorithm that may be considered as a generalization of the traditional total-variation regularization method in the gradient domain. We then unroll the algorithm to construct a neural network for image deblurring which we refer to as Deep Unrolling for Blind Deblurring (DUBLID). Key algorithm parameters are learned with the help of training images. Our proposed deep network DUBLID achieves significant practical performance gains while enjoying interpretability at the same time. Extensive experimental results show that DUBLID outperforms many state-of-the-art methods and in addition is computationally faster.